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TITLE: Improvements in and relating to interactive display systems, particularly 
computer systeins and television sets. 

DESCRIPTION 

The present invention relates to an improved method and apparatus for 
allowing interaction between an individual and a display screen, such as the monitor 
of a computer system <x a television set. 

Human interaction with a display screen, such as a computer monitor, is 
generally achieved by means of a lEqi>oard having keys assigned to a particular 
fimction or ASCII code for typing a specific letter on the screen. Alternatively a 
mouse or track-ball may be used to move a cursor around a computer display screen 
thereby targedng particular feadires or fimctions provided by the system. 

The mouse is moved over a horizontal surface to cause a corresponding 
movement of a crasor over the vertical surfece of the display screen. Once the cursor 
is positioned over the required feature, the mouse is clicked resulting in access being 
gained to the particular chosen feature. The ability to move the mouse cwrectly and 
efficiently does require a significant amount of practise and, even once mastered, does 
necessitate that the cursor be exactly in position to enable the feature to be selected. 
The mouse also lias to be attached, for example by means of a lead, to the computer 
hardware in order to opaate and hence, the operator has to be situated witbin close 
proximity of the computer screen. Fuitiiermore, the mouse has to be moved over a 
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flat surface hence neces^tating the use of a desk or other suitable surface for allowiBg 
interaction with the computer display screen. 

Alternative systems have been developed such as a touch sensitive surface. 
This mvolves the computer screen being divided into particular regions having a 
pictorial or other suitable representation for each region* A pressure-sensitive screen 
is provided over the display to allow the operator to touch the screen and select the 
function or feature by means of the representation corresponding to said feature or 
function. This requires the computer operator to be positioned close to the computer 
screen which is not always desirable. 

Television sets also allow interaction therewith by the user, such as by means 
of a remote controller unit For example, particular features on teletext may be 
selected by pressing an appropriate button on the remote controller unit, such as the 
button which is marked by a particular colour corresponding to a topic covered by 
teletext, such as news, sport or weather. Alternatively, particular directories may be 
accessed by pressing an access numbo- given on the TV screen. The use of icons or 
wording on the remote controller unit may also allow the user to select the feature of 
his or her choice. 

The aforementioned processes do have a number of drawbacks, such as being 
slow to operate due to the requirement to visually select the appropriate button or 
carefully move the mouse to position the cursor in the centre of an icon. The 
dedication of keys to specific functions also severely limits the number of functions 
which may be selected using a remote controller unit or keyboard. It is also not 
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always appropriate for the operator to be in close proximity to the display screen. 

It is an aim of the present inventioii to provide an improved method and an 
^jparatus for allowing interaction between a display saeen and an individual which 
overcomes die above-mentioiied drawbacks. 

According to one aspect of the present invention there is provided an apparatus 
for interaction between an individual and a display screen, the apparatus comprising a 
controller having a phirality of keys having a spatial airangement which corresponds 
to target areas of the display screen, whereby selection of a target area is achieved by 
pressing the key located in the corresponding position on the controller. 

According to a second aspect of the present invention there is provided a 
method of enabling mteiaction between a display screen and an individual otilismg a 
controUer having a plurality of keys disposed in a spacial arrangement which 
correspond to target areas of the display screen, the method comprising the steps of 
identifying the target area of the saeen to be selected; 
translatiiig the position of the target area to a key situated in a corresponding 
position on the controller; and 

pressing die key to transmit an identifying code to select said target area. 
The method and apparatus of the present invention are ioqilemented by means 
of appropriately designed computer software. Computer software is employed to 
define target areas on the display screen having a position which corresponds to the 
spatial relationship of the keys on the controller and to determine what function or 
functions are to be assigned to eadi area and the effect of selection of a particular 
area. 
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Each target area may represent a particular function or multiple function area. 
Di tbe latter case, the multiple fiinctions will be disposed in positions which can be 
equated to the key positions of the controller. By this means, the functions assigned to 
the keys are potentially variable as they correspond to the function indicated in the 
target area of the screen. Software determines the functions assigned to a target area 
according to tbe application being accessed. Accordingly, the keys can be free from 
any numerals, pictograms, colours or other identifying characteristics. 

The particular function or functions represented by an area of the screen is 
preferably represented by displaying an appropriate word, symbol, icon or other 
identifying characteristic in the target area of the screen. The option is then 
dynamically assigned to tiie appropriate key on the controller m a position 
corresponding to the associated target area. 

The display screen is preferably divided into a 3 x 3 grid with the controller 
having a correspondiog spatial airangement of nine keys. The grid may be visible to 
the operator, but most usually the grid is not required to be visible since it may be 
imagined in the operator's mind having regard to the spatial layout of the keys on the 
controller. 

Ahematively, the screen may be divided into a smaller or larger grid, such as 
a2x2or6x6 grid with the controller being provided with a conespoDding number 
of icejrs. If a large number of keys are to be provided, it is preferable to provide 
tactile nipples on the mtended upper surface thereof to aid identification of the 
appropriate key without having to look at the controller. 
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The indivjdual areas of Ihe display screen may each be sdected to divide the 
individual area into a phirality of discrete areas to access fiirther functions subsidiary 
to the first, thei^y enabling multiple functions to be accessed via one original screen, 

such as a 3 X 3 grid. 

It is preferable that any keys which do not correspond to a target area and its 
associated function at any given time are made ten^porarily inoperable. 

The controUer may be in the form of a key pad. More preferably, the 
controUer is in the form of a hand held unit. More preferably sliU, the controller is in 
the form of a remote control unit. The latter is advantageous as the interactioB 
between an individual and the screen may occur with the individual situated some 
distance from the screen. 

It is preferable to provide a remote control unit with large buttons such that 
the operator is able to locate the appropriate button easily. 

The method and apparatus of the present invention may be used for a wi<fc 
raAge of applications depending upon the computer prolan which implements the 
particular visual interface. For example, the interactive method and apparatus of the 
present invention may be used for computer games, such as chess, with moves being 
made by an individual using the keypad or remote control unit of the present 
invention. The interactive display system may also be used to edit text on a display 
saeen. 

The method and apparatus of interactive communicatiOT between an individual 
and a display screen of the present invention may also be utilised for interfacing with 
a domestic television set which contains a microprocessor. For ejomple, the options 
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for audio, picture and cbaooel settings may each be presented in a region of the 
television screen and be selected by pressing the button corre^nding in location to 
the area in which the required option is displayed on the screen. The selected option 
may then show further options which may be selected by again identifying their 
relative location on the screen and translating it to the controller. Preferably, the 
available options which are visible over the television sa-een are automatically 
removed after a few moments of inactivity. 

For a better understanding of the present invention and to show more clearly 
how it may be carried into effect, reference will now be made by way of example 
only to the accompanying drawings in which > 

Figme 1 is a perspective diagram of a interactive system according to one 
embodiment of the present invention; 

Figure 2a is a front view of an interactive system according to another 
embodiment of the present invention; 

Figure 2b is a cross section of the remote control unit shown in Figure 2a, 
taken along lines A - B; 

Figure 3a is a sketch diagram of a remote control unit of an interactive system 
according to the present invmtion for playing a game of chess; 

Figures 3b and 3c are sketch diagrams of a computer monitor of an interactive 
system according to the present invention for playing a game of chess; 

Figures 4a to 4d illustrate the steps involved in making one type of movement 
during a game of chess using the system shown in Figures 3a to 3c; 

Figuie 5 is a sketch diagram of an interactive system according to the present 



inveation for text editing; 

Figure 6 is a sketch diagram of a television screen of an int^ctive system for 
selecting TV cbannels; 

Figure 7 is a sketch diagram of a television screen of an interactive system for 
adjusting TV settings; 

Figure 8 is a perspective diagram of a remote control unit for use with the 
method and system of the present invention; 

Figure 9 is a flow chart illustrating typical steps in the method of the invention 
for one embodiment; 

Figure 10a shows an example of a screen layout; and 

Figure 10b shows how the same screen layont is modified to provide positive 
feedback to the user. 

Referring to Figure 1 of the accompanying drawings, an interactive computer 
system 1 is shown having a visual display screen and a band-held remote control unit 
4. The remote control unit has nine buttons a to i arranged in a 3 x 3 grid which are 
free from any numerals, pictograms, colours or other identifying characteristics. The 
visual display screen, such as a cathode ray tube or liquid crystal display panel, is 
shown at 2. For the convenience of e3q)lanation, the display area of the screen is 
shown divided into a 3 x 3 grid 8 thereby dividing the screen into nine areas A to I 
which represent target areas and their position corresponds to die positions of buttons 
a to i on the remote control unit 4. 

The grid 8 is not required to be visible to the eye since the operator is able to 
visualise how the position of the keys translates to corresponding target areas on the 
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display saeen. The operator selects a desired target area on the display screen by 
simply pressing the corresponding button wWch is located on the remote control in 
the same region as the desired target area on the screen. This aUows the operator to 
select a target area without the need to look at the remote control imit and without 
means of identification being provided on the control unit. Hence, any function may 
be assigned to a button depending upon the particular visual interface program which 
is incorporated into the computer system. No pictorial representations or other 
instructions are located on the remote control unit and thus, the individual buttons of 
die control unit are not restricted to the particular function assigned thereto. Total 
interaction between the operator and the display screen is caiiied out using a Umited 
number of buttons relying on the ability of humans to be aWe to select the appropriate 
button corresponding to the target area of interest. This enables the selection to be 
made more rapidly since the operator does not need to visually identify the correct 
button and hence, allows the operator to keep watching the display screen at all tiroes. 
Furthermore, the present invention enables the display screen to be operated from a 
distance wlAout the need for a flat surface to support the remote control uflit; 

Most usually die target location on the display screen is identified by placing 
appropriate words, symbols or icons into a target location, for example in one or 
more of areas A to I, on the display screen and dynamically assigning those options to 
the associated key. This is achieved by means of appropriate software. The operator 
selects the function required by means of the visual representation displayed m an 
area of the display screen and transhites this target position to the corresponding 
button on the remote control unit. Pressing the button transmits an identifying key 
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code to the display screen thereby causing the desired operatioii to be executed. 

It is possible to use this targetiiig facility in conjunction with appropriate 
software as a means of enlarging, for example to M screen size, die information 
shown in a selected target ai«a . The expansion can be repeated by cany tag out one or 
more successive tai^eting operations. lUe mimber of practical enlargements will 
depend upon the ability of the source data to provide the desired definition. On the 
odier hand, the targeting facility can be used to home in quickly on a particular area 
or part of the screen. In this case, it cm be advantageous to have the software 
generate a grid on the screen whereby each successive key operation generates a grid 
or matrix corresponding to the key grid or matrix oo the controller. 

The size of grid overlaying the display screen and corresponding mimber of 
buttons provided on a remote control unit or keypad arc not limited to a particular 
size and number. For example, a i«mote control unit 5 with thirty six buttons 7 
could be provided for operation of a display screen 3 divided into a 6 x 6 grid, as 
illustnted in Figiii« 2a of the accompanying drawings. The right hand view in Figure 
2a shows the outline of a display screen 3 superimposed over the buttons 7 in Older to 

illustrate how the position of the buttons can be visually equated to corresponding 
areas of the screen. Tactile nipples 11 (such as those commonly used on QWERTY 
keyboards) may be provided on the surface of the buttons to assist the operator in 
locating the appropriate button without the need to look at the buttons to coofinn their 
retative location (as shown in Figure 2b). However, it is to be ajqjreciated that the 
fewer target locations there are, the easier it wiU be for the operator to locate the 
associated button and thereby perform the desired task. 
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The target areas of the display screen may be chosen to result in the particular 
area selected being divided into a further number (usually a corresponding number) of 
regions which may then be selected using the same buttons. In this manner, fer more 
features may be available to the operator by means of only a limited number of 
buttons on the keypad or remote control unit. The first and indeed any successive 
selected target areas may be expanded up to occupy the entire display screen. 

As mentioned above, the general purpose carried out by the interactive system 
will depend upon the computer programme which implements a particular visual 
interface. The following examples iUustrate some of the possible activities which may 
be carried out using the method and apparatus for interactive communication between 
an operator and a display screen according to the present invention, 

Eample I 

The interactive display system may be used to play a game of chess on, for 
example, a television-based computer system from the comfort of an annchah". The 
system has a remote control unit 4 having nine buttons arranged in a 3 x 3 grid, each 
button being given a two-letter identification code TL, TC, TR (top left, top centre, 
top right and so on) as illustrated in Figure 3a of the accompanying drawings. It is to 
be ^reciated that these codes need not actually be present on die controller unit, 
since their code is readily apparent from their positioning, but are included herein to 
allow a satisfactory explanation of the method of playing the g^me of chess by means 
of the interactive method and apparatus of the present invention. 



The entire screen 8 displays an 8 x 8 grid corresponding to a conventional 
chess board. The grid is given the traditional chess notation A...H, 1...8 in Figures 
3b and 3c to illustrate the particular squares of tiie chess board. This larger grid is 
then divided into a 3 x 3 grid, identified by the grids TCB, LCR in Figures 3b and 3c 
representing tiie miiror image of tiie spatial arrangement of the buttons provided on 
the remote control unit 4 shown in Figure 3a. 

The chess player can execute any move in four button presses. For instance, 
if tiie operator presses button TL on flie remote controUer unit 4, tiie display screen 
will highlight the smaller 3x3 target area TCBLCR illustrated in tiie top left hand 
comer of Figure 3c. The operator may now select one of ti»e four available squares 
by pressing one of tiie buttons CC, CR, BC, BR (preferably tiie buttons which do not 
correspond to any of tiie chess squares are made inoperative). In Has manner, any 
chess move may be made by means of lour button presses since each square is 
identified by a two-button sequence, tiie first targeting ttic entire display area and a 
second targeting a new grid covering the area targeted by tiie first 

Figure 4a to 4d illusttate tiie steps in maldng tiie move from square B7 to D5 
(standard chess notation) during a game of chess. Selecting tiie top right hand button 
(TR) targets tiie top right hand grid of tiie entire display screen, as shown in Figure 
4a. This region, once selected, can tiien be divided into a similar grid (see Fig. 4b). 
Pressing flie bottom centre button (BC) will target tfie square B7 (see Fig.4c). 
Movement to D5 is tiien achieved by selecting flie central centre button (CCO, 
followed by tiie central right button (CR), as shown in Figure 4d. 



12 



The use of multiple key presses as described in relation to Example 1 may be 
affiled in many ways. For example, the use of the two-tier syst^ may be used to 
edit text shown on a display screen, as illustrated in Figure 5. 

The display screen 10 is divided into a 3 x 3 grid (TL,TC,TR and so on) as 
described above in relation to the chess game. The top row of buttons are assigned 
the letters of the alphabet by means of a second 3x3 grid being provided covering 
each square of the top row and a shift button is provided to present additional 
symbols for typing. Positions CL, CC, BL, BC are occupied with the text to be 
edited and hence, these buttons are made inoperable by the implemrating software. 
Finally, the two remaining positions of the parent grid (RC^ BR) are assigned with 
buttons for scrolling the text up and down. 

The text may be edited as follows. In relation to the last word typed in the 
area of text shown in figure 5 (i-e, WHICH), the buttons which were pressed to type 
this word onto the display screen arc TC, BC, TR, TC, TR, TR, TL, TR, TR, TC, 

Esamplg 3 

The interactive system of the present invention may also be utilised for 
interfiacing with a domestic television set. The majority of present day television sets 
include a microprocessor-based method for adjusting the settings for audio, picture 
and channel settings, typically using special keys provided on the remote controller 



unit of the television set which are dedicated to these specific functicxis. Howev^, by 
presenting these options on the television screen in predetermined spatial locations, it 
is possible to execute a number of adjustments, including channel selection and 
control settings using a grid for targeting the entire television sa"een and a second 
grid covering the area of the screen located by the first, as hereinbefore described. 

For example, the user would press any key on the spatial grid to call up a set 
of options as shown in Figure 6. These settings could then be selected using the 
coirespohding button on the remote controller. The bottom rig^t hand grid has a 
second 3x3 grid which becomes visible over the entire screen on pressing the 
correqwnding button (BR). Further functions are then visible on the screen and may 
be chosen using the appropriate button. After a few moments of inactivity the 
overlay identifying the different features would be removed from the television 
screen. 

It is preferable that a user-friendly remote controller unit is provided as part of 
the interactive system of the present invention, having the minimum amount of 
buttons with few identifying characteristics contained therran. The buttons are 
preferably weU defined and relatively large vis a vis the remote control units of the 
prior art to aid selection of the appropriate button by identifying the associated target 
area on the screen, far example, Figure 8 illustrates a new design of headset 28 
which is easy to operate, having a 3 x 3 array of main controller buttons 30 for 
selecting the chosen function appearing in a conespondrng region of the display 
screen. The handset 28 also has mode buttons 32 positioned below the main controller 
buttons, such as "reset", "back", "help" and "set up" buttons. These are arranged in 



a diffa-ent pattern to the main controller buttoi^ to enable the operator to readily 
identify the two sets through touch without the need to look at the handset. Further 
buttons 34 may be provided below the mode buttons and a "power* button 36 may be 
provided towards the base of the handset. 

This type of interactive system also has a potentially wide field of application 
for browsing through the large number of channels and services which may be 
provided through a television set* For example, the system may be used to allow 
home shopping via shoj^ing catalogues accessed via the television set. The system 
would allow particular goods of interest to the vieww^ to be easily and quickly called 
up be pressing the button corresponding to the ^prcpiate target area on die screen. 
The system may also be used for interactive television prognunmes^ for example, 
when viewers are required to vote for a particular subject or to allow easy access 
through the teletext systems without having to carefully read the individual buttons on 
a remote controller unit which are specific to carrying out one particular function. 

Referring now to figure 9 tiiere is illustrated a flowchart which diows the 
typical steps in performing the method of the invention according to one embodiment. 
Box 101 conceros generation of the on screen display which for the purpose of this 
example is as shown in figure 10. Five icons are portrayed, three along the top of 
the screen, one m the bottom right hand comer of the screen and one on the left hand 
side of the screen mid way between the ttip and the bottom- It is assumed that Ae 
controQer has a matrix of 3x3 buttons and it will be seen that the icons occupy only 
some of the positions of a 3x3 mattix, but that their positions can be readily equated 
to the positions of the buttons on the controller . 



The other boxes in the flow chart are 103 which corresponds to the step of 
noting that a keypress has occurred and been received, box 105 which ascertains 
whether the key pressed matches a target ar^a, box 107 which provides negative 
feedback to the operator where there is no match between the keypressed aiKl a target 
area. The negative feed back may be a lack of response, an available signal and/or a 
suitable message signal prompting the user to try again. The program waits for the 
user to make another selection. Box 109 provides positive feedback to the user when 
a match has been found between the keypressed and a designated target area. The 
selected icon may change colour, flash, or be highlighted to denote to the user the 
function switch has been selected. Figure 10b shows the icon in the middle <m the 
top row in a diiferent colour thus sigmfying that the middle key on the top row has 
been pressed. Finally, box 111 represents execution of the selected function. This 
may result in the generation of a new screen display requiring further key inputs until 
the users chosen program sequence has completed or the user wishes to exit the 
program* 
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CLAIMS 



1. An apparatus for interactioii between an individual and a display screen, the 
apparatus comprising a controller having a plurality of keys having a spatial 
airangement which corresponds to target areas of the display screen, whereby 
selection of a target area is achieved by pressing the key located in the corresponding 
position on the controller. 

2. An apparatus as claimed in claim 1, wherein a specific function is assigned to 
each target area by means of appropriately designed computer software. 

3. An apparatus as claimed in claim 1, wherein a target area represents a multiple 
function area. 

4. An apparatus as claimed in claim 3, wherein the multiple functions of a given 
target area are di^sed in positions which can be equated to the key positions of the 
controller. 

5. An apparatus as claimed in claim 2, 3 or 4, wherein the particular function or 
fiinctions represented by an area of the screen is represented by displaying an 
appropriate word, symbol, icon or other identifying charaaeristic in the target area of 
the screen. 

6- An apparatus as claimed in any one of the preceding claims, wherein the 
display screen is divided into a grid with the controller having a corresponding spatial 
arrangement of keys. 

7. An apparatus as claimed in claim 6, wherein the grid is visible to the operator. 

8. An apparatus as claimed in claim 6, wherein the grid is invisible to the 
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operator. 

9. An apparatus as claimed in any one of claims 2 to 8, wherein the individual 
areas of the display screen may each be selected to divide the individual area into a 
plurality of discrete areas to access further functions subsidiary to the first thereby 
enabling multiple functions to be accessed via one original screen. 

10. An apparatus as claimed in claim 9, wherein any keys which do not 
correspond to a target area and its associated function at any given time are 
temporarily inoperable. 

11. An apparatus as claimed in any one of the precedmg claims wherein the 
controller is in the form of a key pad. 

12. An apparatus as claimed in any one of claims 1 to 10, wherem the controller 
is in Ae form of a, hand held unit. 

13. An apparatus as claimed in claim 12, wherem the controUer is a remote 
control unit. 

14. An apparatus as claimed in any one of the preceding claims for use in playing 
a game whereby a move in a game is made by an individual pressing a key on the 
controUer corresponding in position to the required location to be selected on the 
screen. 

15. An apparatus as claimed in any one of claims 1 to 13 , for use in text editing. 

16. An apparatus as claimed in any one of claims 1 to 13, for use in interfacing 
with a domestic television set containing a microprocessor. 

17. An apparatus as claimed in claim 16, wherein the television control functions 
are presented in a region of the television screen for selection by pressing the key 
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correspoQding in location to the area in which the required control function is 
displayed on the screen. 

18. An apparatus as claimed in claim 17, wherein the displayed functions are 
removed from the screen after a predetermined period of inactivity* 

19. An apparatus substantially as bereint)efore descril>ed with reference to and as 
illustrated m any of Figure 1, Figures 2a and 2b, Figures 3a to Figure 5, Figures 
6 and 7 or Figure 8 of the accompanying drawings. 

20. A method of enabling interaction between a display screen and an individual 
utilising a controller having a plurality of keys disposed in a spatial arrangement 
which correspond to target areas of the di^lay screen, die method comprising the 
steps of:- 

identifying the target area of the screen to be selected; 

translating the position of the target area to a situated in a corresponding 

position on the controller; and 

pressing the key to trans^mit an identifying code to select said target area. 

21. A method substantially as hereinbefore described with reference to any one of 
the accompanying Examples, 
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